Mathematical Ranking of AI Classifiers Using Confusion Matrix and Matthews Correlation Coefficient
نویسندگان
چکیده
This research primarily deals with mathematically ranking the level of accuracy various Artificial Intelligence (AI) based machine learning classifiers, using Mathews Correlation Coefficient (MCC), leveraging Confusion Matrices. A detailed Literature survey was done to gather existing knowledge. knowledge used as foundational basis further build scope this project. The classifiers were Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Convolutional Neural Network (CNN). These for Face recognition individuals. total 33 adult test subjects 10 images per subject resulting in a 330 distinct part from Labeled Faces Wild publicly available database along teachers James B. Conant High School who voluntarily participated research. Python face program wrappers associated environment built around pre-existing image data passed these wrappers. recognized faces individuals over trials wherein each trial consisted images, varying degree presented that outputs. outputs determine Matrices which turn calculate MCC scores. scores plotted, results showed SVM AI classifier had highest relative recognition, followed by KNN CNN classifiers.
منابع مشابه
Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric
Data imbalance is frequently encountered in biomedical applications. Resampling techniques can be used in binary classification to tackle this issue. However such solutions are not desired when the number of samples in the small class is limited. Moreover the use of inadequate performance metrics, such as accuracy, lead to poor generalization results because the classifiers tend to predict the ...
متن کاملConfusion Matrix Disagreement for Multiple Classifiers
We present a methodology to analyze Multiple Classifiers Systems (MCS) performance, using the disagreement concept. The goal is to define an alternative approach to the conventional recognition rate criterion, which usually requires an exhaustive combination search. This approach defines a Distance-based Disagreement (DbD) measure using an Euclidean distance computed between confusion matrices ...
متن کاملthe use of appropriate madm model for ranking the vendors of mci equipments using fuzzy approach
abstract nowadays, the science of decision making has been paid to more attention due to the complexity of the problems of suppliers selection. as known, one of the efficient tools in economic and human resources development is the extension of communication networks in developing countries. so, the proper selection of suppliers of tc equipments is of concern very much. in this study, a ...
15 صفحه اولConfusion Matrix
A confusion matrix (Kohavi and Provost, 1998) contains information about actual and predicted classifications done by a classification system. Performance of such systems is commonly evaluated using the data in the matrix. The following table shows the confusion matrix for a two class classifier. The entries in the confusion matrix have the following meaning in the context of our study: ● a is ...
متن کاملsynthesis of amido alkylnaphthols using nano-magnetic particles and surfactants
we used dbsa and nano-magnetic for the synthesis of amido alkylnaphtols.
15 صفحه اولذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Student Research
سال: 2022
ISSN: ['2167-1907']
DOI: https://doi.org/10.47611/jsrhs.v11i3.3113